#multimodal foundation models

A recent EPFL study benchmarks multimodal foundation models like GPT-4o on core vision tasks, revealing strengths in semantic understanding but highlighting gaps compared to specialized vision models.

The PHYX benchmark uncovers key weaknesses in current multimodal AI models’ ability to perform physical reasoning, emphasizing the challenge of integrating visual data with symbolic and causal knowledge.